Zero-shot image classification using coupled dictionary embedding

نویسندگان

چکیده

Zero-shot learning (ZSL) is a framework to classify images that belong unseen visual classes using their semantic descriptions about the classes. We develop new ZSL algorithm based on coupled dictionary learning. The core idea enforce features and attributes of an image share same sparse representation in intermediate embedding space, modeled as shared input space two sparsifying dictionaries. In training stage, we use from number seen for which have access both train dictionaries can represent feature vectors single vector. testing stage absence labeled data, are mapped into attribute by finding joint-sparse representations solely via solving LASSO problem. then classified given also provide attribute-aware transductive formulations tackle “domain-shift” “hubness” challenges ZSL, respectively. Experiments four primary datasets VGG19 GoogleNet features, provided. Our performances 91.0%, 48.4%, 89.3% SUN, CUB, AwA1 datasets, AwA2 57.0%,49.7%, 71.7%, respectively, when used. Comparison with existing methods demonstrates our method effective compares favorably against state-of-the-art. particular, leads decent performance all datasets.2

برای دانلود باید عضویت طلایی داشته باشید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Zero-Shot Visual Recognition using Semantics-Preserving Adversarial Embedding Network

We propose a novel framework called SemanticsPreserving Adversarial Embedding Network (SP-AEN) for zero-shot visual recognition (ZSL), where test images and their classes are both unseen during training. SP-AEN aims to tackle the inherent problem — semantic loss — in the prevailing family of embedding-based ZSL, where some semantics would be discarded during training if they are nondiscriminati...

متن کامل

Transductive Unbiased Embedding for Zero-Shot Learning

Most existing Zero-Shot Learning (ZSL) methods have the strong bias problem, in which instances of unseen (target) classes tend to be categorized as one of the seen (source) classes. So they yield poor performance after being deployed in the generalized ZSL settings. In this paper, we propose a straightforward yet effective method named Quasi-Fully Supervised Learning (QFSL) to alleviate the bi...

متن کامل

Zero-Shot Sketch-Image Hashing

Recent studies show that large-scale sketch-based image retrieval (SBIR) can be efficiently tackled by cross-modal binary representation learning methods, where Hamming distance matching significantly speeds up the process of similarity search. Providing training and test data subjected to a fixed set of pre-defined categories, the cutting-edge SBIR and cross-modal hashing works obtain acceptab...

متن کامل

Transductive Zero-Shot Learning with a Self-training dictionary approach

As an important and challenging problem in computer vision, zero-shot learning (ZSL) aims at automatically recognizing the instances from unseen object classes without training data. To address this problem, ZSL is usually carried out in the following two aspects: 1) capturing the domain distribution connections between seen classes data and unseen classes data; and 2) modeling the semantic int...

متن کامل

Zero-Shot Learning for Semantic Utterance Classification

We propose a novel zero-shot learning method for semantic utterance classification (SUC). It learns a classifier f : X → Y for problems where none of the semantic categories Y are present in the training set. The framework uncovers the link between categories and utterances through a semantic space. We show that this semantic space can be learned by deep neural networks trained on large amounts...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: Machine learning with applications

سال: 2022

ISSN: ['2666-8270']

DOI: https://doi.org/10.1016/j.mlwa.2022.100278